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Abstract 

Effects of distractions sucli as noises and parameter lieterogeneity have been studied on the 
firing activity of ensemble neurons, each of which is described by the extended Morris-Lecar 
model showing the graded persisting firings with the aid of an included Ca^^-dependent cation 
current. Although the sustained activity of single neurons is rather robust in a sense that the 
activity is realized even in the presence of the distractions, the graded frequency of sustained 
firings is vulnerable to them. It has been shown, however, that the graded persisting activity 
of ensemble neurons becomes much robust to the distractions by the pooling (ensemble) effect. 
When the coupling is introduced, the synchronization of firings in ensemble neurons is enhanced, 
which is beneficial to firings of target neurons. 
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1 Introduction 

It has been reported that persistent activity of neurons is ubiquitous in hving brains. 
Such persistent, stimulus-dependent activities are expected to be neuronal substrates 
of the short-term working memory (Brody, Rome and Kepecs, 2003). For example, in 
the prefrontal cortex of monkeys which are trained by short-term tasks, the persisting 
activity has been interpreted as a basis of working memory for a few seconds (Funahashi, 
Bruce and Goldmanrakic, 1989; Miller, Erickson and Desimone, 1996; Romo, Hermandez, 
Lemus, Zainos and Brody, 2002). In the area I of goldfish hindbrain which controls 
the motor systems deriving the eye muscle, the persisting activity is interpreted as a 
short-term memory of the eye position that keeps the eye still between saccades (Pastor, 
Delacruz, and Baker, 1994; Seung, 1996; Aksay, Baker, Seung and Tank, 2000). In the 
later example, oculomotor neurons are considered to integrate the velocity information 
from the eye movement, yielding information on the eye position. 

One of the problems of the observed persisting activity is how to keep it for extended 
periods. Most models previously proposed are based on the recurrently coupled neural 
networks (Rosen, 1972; CannonCRobinson and Shamma, 1983; Seung, Lee, Reis and 
Tank, 2000, Miller, Brody, Romo and Bang, 2003). These models may account for the 
observed property of the persistent activity. They have, however, a serious drawback 
requiring the fine tuning of the network-feedback gain within a tolerance of less than 1% 
to stabilize the firing rate expressing stored information. If the overall gain of the network 
is slightly increased than the critical value, it leads to a divergent activity. On the other 
hand, if the gain is slightly decreased than the critical value, the state reduces to the stable 
fixed point without firings, losing the memory stored in the firing rate. Some homeostatic 
mechanisms such as an activity-dependent scaling of synaptic weights (Renart, Song and 
Wang, 2003) have been proposed for stabilizing the neural activity. 

A new mechanism based on the bistability of neurons has been proposed (Rosen, 
1972, Guigon, Dorizzi, Burnodand Schultz, 1995, Koulakov, Raghavachari, Kepec and 
Lisman, 2002). Two specific ways to realize bistable elements have been discussed: one by 
local excitation connections and the other by the voltage-dependent N-methyl-D-aspartate 
(NMDA) channel (Lisman, Fellous and Wang, 1998). Recurrent networks consisting of 
bistable elements have been shown to robustly operate even when the model parameters 
are not well tuned. It is, however, unclear whether the prediction of the bistable neuron 
is consistent with experimental data from neuronal integrators. For example, bistable 
neurons are reported to be absent in the goldfish oculomotor neurons which show the 
persistent activity (Pastor et al, 1994; Aksay et aL, 2000). 

Quite recently, the graded persistent activity has been observed for single neurons in 
vitro of the layer-V entorhinal cortex (EC) of rats (Egorov, Hamam, Fransein, Hasselmo 
and Alonso, 2002). The sustained firing rate of the neurons is shown to be proportional to 
the integral over time of its previous synaptic input. EC in the parahippocampal region is 
known to be associated with the working memory (Frank and Brown, 2003). It has been 
shown that EC neurons display persisting activity during the delay phase of delayed mach 
or non-match to sample memory task (Suzuki, MuUer and Desimone, 1997, Young, Otto, 
Fox and Eichenbaum, 1997). A phenomenological rate-code model including multiple 
bistable dendrites has been proposed (Goldman, Levine, Major, Tank and Seung, 2003). 
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It has been suggested that the calcium concentration is a plausible candidate for the 
observed parametric working memory (Egorov, Hamam, Pransein, Hasselmo and Alonso, 
2002). Several conduction-based neuron models have been proposed based on Ca^''"-ion 
channel. Lowenstein and Sompolinksy (LS) (2003) have shown that by the diffusion of 
the non-linear dynamics of the calcium concentration in bistable dendrites, the wave- 
front of calcium propagates at a speed proportional to the synaptic inputs. When the 
Ca^"'"-dependent cation is included in a neuron model described by the HH-type model 
(Shriki, Hansel and Sompohnsky, 2003), calculated firings show the behavior similar to 
the observed one. Teramac and Fukai (2003) have proposed detailed conductance-based 
models in which both L-type Ca channel and Ca^^-dependent cation channel are taken 
into account. 

It is interesting that in contrast to recurrent neural networks with bistable neurons, 
single neurons with bistable dendrites may store information in the form of the graded 
persisting activity. For a reliable performance of information storage, such single neurons 
are required to be robust against distractions such as noises and heterogeneity in neuron 
elements. It was reported (Mainen and Sejnowsky, 1995) that although firings of single 
neurons in vitro are precise, those in vivo are quite unreliable due to noisy environment. 
This may suggest that noises in vivo might make the graded persisting activity of EC 
neurons unreliable. Experiments on EC neurons in vivo are needed although they are 
difficult owing to the problem in performing the intracellular recording in awake animals. 

A small cluster of cortex generally consists of many similar neurons which include 
some degree of heterogeneity. Each neuron generates spikes which propagate to synapses 
exciting neurons in the next stage. It has been recognized that the population of neuron 
ensembles plays important roles in the information transmission. The population improves 
the reliability of response of noisy neurons. For example, the stochastic resonance in 
neuron ensembles is much effective than that of single neurons. An advantage of the 
synchronized activity is a large input on a target neuron. 

Prom these considerations, we will make, in this paper, a theoretical study on the 
robustness of the parametric working memory, taking account of two factors: (1) neuron 
ensembles with (2) the heterogeneity and noises. In order to investigate the property of 
the persisting activity of an ensemble against noises and heterogeneity, we will perform 
simulations on ensemble neurons, each of which shows the persisting activity. We first 
develop a minimum, single neuron model, which is suitable for a simulation of ensemble 
neurons. The Morris-Lecar (ML) model, which was initially proposed for a barnacle giant 
muscle fiber, has been widely employed for a study on neuron dynamics (Morris and Lecar, 
1981; Rinzel and Ermentrout, 1989). Although the ML model is the reduced, simplified 
model of the detailed HH model, it is more realistic than the integrate-and-firc model. A 
new variable for the calcium channel whose function depends on Ca^'^-ion concentration 
has been incorporated to the ML model. With the aid of Ca^''"-dependent current, a single 
ML neuron may show the graded persisting activity. 

The paper is organized as follows. The property of a single (extended) ML model 
is discussed in Sec. 2, where effects of noises and variations of model parameters are 
investigated. In Sec. 3, we have studied a neuron ensemble where each neuron is described 
by the extended ML model proposed in Sec. 2. Effects of noises and the heterogeneity of 
model parameters on the persisting activity have been investigated. The synchronization 
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within neuron ensembles is also discussed. Conclusions and discussions are given in Sec. 
V. 



2 Dynamics of a single neuron 
2.1 Adopted model 

We have adopted the extended ML neuron model for a single neuron, given by 
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The model given by Eqs. (I)-(IO) takes into account the non-specified cation current {Icat) 
besides Ca, K and leakage currents {Icai Ik and II) which are included in the original 
ML model (Morris and Lecar, 1981; Rinzel and Ermentrout, 1989); v and w denote 
the fast membrane potential and the slow auxiliary variable, respectively; z expresses 
a new variable for the Ca^^-ion concentration which is relevant to the cation channel. 
The variable z controls the conductance of the cation channel which yields the persistent 
parametric activity, as will be shown later. The equation of motion for z is assumed to 
be given by Eq. (3), where 6, d and stand for the drift velocity, the coefficient, and 
the life time, respectively. Equation (3) may be justified, to some extent, by the model 
proposed by LS (Loewenstein and Sompolinsky, 2003), details being given in appendix 
A. The explicit form of an input current I{t) will be shown shortly [Eq. (11)]. 13^ and j3z 
express the strengths of independent white noises given by ^{t) and r}{t) with zero means 
and < i(t) i{t') >=< 7]{t) ri{t') >= 6{t - 1') and < i{t) r]{t') >= 0. In this study, we have 
adopted the following parameters: the capacitance is C = 20, the reversal potentials of Ca, 
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K, cation channels and leakage are vca. = 120, vk = —84, Vcat = 40 and vi, = —60, and the 
corresponding conductances are gca = 4:, qk = 8, Qcat — 1 and gi, = 2: other parameters 
are vi = -1.2, V2 = 18, V3 ^ 12 V4 ^ 17.4, = 0.0667 (Rinzel and Ermentrout, 1989), 
a = 39.6, b = 0, d — 0.0001 and = 00: values of [3^ and [3^ will be shown shortly (in 
this paper, conductances are expressed in mS/cm'^, currents in fiA/cm'^, voltages in mV, 
the time in ms and the capacitance in /xF/cm^). These parameter have not necessarily 
been chosen so as to reproduce observed data of EC (Egorov et al, 2002). 

2.2 Calculated results 

2.2.1 Property of the extended ML model 

It is noted that our ML model with these parameters can start firings from the zero 
frequency when the parameter of a is varied for oi < a < 02 where the critical values 
are Oi = 40 and 02 = 116 jiA/cm?' for 6 = and I{t) = [see Fig. 7.6 of Rinzel and 
Ermentrout, 1989]. Then our ML neuron belongs to the type-I neuron. Although the 
linearity of the a — f relation at a > ai is not perfect, it does not matter for our purpose 
discussing effects of distractions on the persisting activity. 

We apply to our ML neuron, an input signal consisting of four pulses as given by 

m = y: m =ay: c^mt - t«) - e(t - t» - r^)], (n) 

n=l n=l 

where stands for the magnitude of a pulse, T^*) = 1000 n ms (n: integer), Tyj = 200 ms, 
Cn — I (—1) for n = 1 — 3 (n = 4), and Q{t) is the Heaviside function. We have adopted 
Ai — 20 nA/cm? otherwise noticed. 

Equations (l)-(ll) have been solved by the fourth-order Runge-Kutta method with 
a time step of 0.01 ms, the initial condition being given by f (0) = —40, w{{)) = and 
^(0) = 0. Figure 1(a) shows time courses of v, w, and z when I{t) given by Eq. (11) is 
applied to our ML neuron, I{t) being depicted at the bottom of Fig. 1(a). The variable z 
is proportional to the integral on time of an input signal [Eq. (3)], and it shows a step- wise 
behavior: z is changed while an input pulse given by Eq. (11) is added and it stays at 
plateau values of z = 0.02, 0.04 and 0.06 between input pulses. Figure 1(b) shows time 
courses of currents of Ik, Ica and I cat- It is noted that Ica and I cat are inward (negative) 
currents while Ik is the outward (positive) one. When an input pulse is applied to a ML 
neuron, z is increased, which triggers a flow of Icat and the oscillation of state variables. As 
z is furthermore increased by an injected pulse, the frequency of firing is increased. This 
is more clearly seen by circles in Fig. 1(c), which shows the time-dependent frequency 
fit) defined as the inverse of the interspike interval (ISI) given by 

Tn{tn) — tn+l ~ tfi, (12) 

tn being the nth firing time defined as the time when v{t) crosses the threshold 9 (—10 mV) 
from below. Neurons fire most strongly during the transient response to applied pulses 
and settle to a persistent firings which depend on the integral on time of the past inputs. 
An initial 200-ms depolarizing pulse results in a sustained firing of 5.1 Hz, and the second 



6 



and third ones increase the frequency to 7.6 and 9.0 Hz, respectively, while a persisting 
firing backs to 7.6 Hz after the fourth hyperpolarizing pulse. We note that the firing 
frequency f{t) is successively increased (decreased) when depolarizing (hyperpolarizing) 
pulses are applied, and that the frequency is constant with plateaus between applied 
pulses. This trend is realized also in histogram in Fig. 1(d) expressing the firing rate r{t) 
for various time bins of Tf, = 200 (solid curve), 400 (dashed curve) and 600 (chain curve). 
The rate with the small time bin of = 200 reproduces the transient behavior while 
impulses are applied, although it shows an oscillation at the plateau period. In contrast, 
the rate with large T5 = 600, the persisting firings are well explained while the transient 
firings are averaged out. When the magnitude of pulses Ai is increased (decreased), the 
value of f{t) at plateau is increased (decreased), as shown by triangles {Ai = 30) and 
inverted triangles {Ai = 10) in Fig. 1(c). For example, the first depolarizing pulse with 
Ai — 10, 20 and 30 jiA/cw? yields the sustained firing frequencies of 2.9, 5.1 and 6.5 Hz, 
respectively. Similarly, when the duration of pulses T^^, is increased (decreased), the value 
of f{t) at plateau is increased (decreased) (results are not shown). Calculated results are 
similar to those experimentally obtained for single EC neurons. (Egorov et al, 2002). 

Figures 2(a) and 2(b) show the v — w and z — v phase planes for firings shown in Fig. 
1. For a comparison, nuUchnes of Eqs. (1) and (2) for a — 39.6, h — z — Q and 7 = 
are shown by dashed and chain curves, respectively, which have a tangentially contact 
at {v,w) = (—29.6, 0.00846). The solid curve in Fig. 2(a) shows that the cycle starts 
from {v,w) = (—40, 0) and circles counter-clockwise almost independently of the z value. 
Figure 2(b) shows that between the plateau values oi z = 0.02, 0.04 and 0.06, v oscillates 
against z, and that v changes vertically when z stays at these plateau values. 

2.2.2 Effects of model peirameters of a and b 

We will investigate effects of parameters when their values are changed. Among many 
model parameters included in Eqs. (I)-(IO), we have chosen a and b as the parameters 
to be changed because they are expected to play an important role in stabilizing the 
persisting firings. Figure 3(a) shows the time course of f{t) for various a values of a =39, 
39.6 and 41 ixA/cm? with 6 = 0. For a = 41, a neuron fires with / = 5.2 Hz at t < 1000 ms 
before the first pulse is applied, and firing frequencies after the second, third and fourth 
inputs are larger than those for a — 39.6. In contrast, the firing frequency for a = 39 is 
smaller than that for a = 39.6. 

Figure 3(b) shows f{t) for various b values of 6 = —2, 0, and 2 (xlO~^) with a = 39.6 
jiA/cm^. The result for 6 = is the same as that shown by circles in Fig. 1(c). For 
6 = — 2 X 10~^, f{t) between pulses is gradually decreased. For 6 = 2 x 10~^, in contrast, 
the frequency shows a positive drift. 

2.2.3 Effects of white noises 

Next we add white noises to our ML neuron. The time course of the frequency f{t) when 
white noises oi f3y = A arc added to the variable v in Eq. (1), is shown by dots in Fig. 
3(c), where open circles express the result with no noises. Because of added noises, the 
frequency of persisting firings fiuctuates. A similar behavior has been realized when noises 
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are added to the variable z in Eq. (3), whose result for = 2 is shown by dots in Fig. 
3(d). 

Figures 3(a)-3(d) show that a single neuron is rather robust in a sense that the per- 
sisting firings are possible even when distraction arc added. Wc note, however, that the 
frequency of the persisting firings is modified by distractions. The robustness is much 
improved in ensemble neurons by the pooling effect, as will be discussed in the following 
Se. 3. 



3 Dynamics of neuron ensembles 
3.1 Adopted model 

We have assumed that an ensemble consisting of A^-unit ML neurons stores information 
from an applied signal of /(i). Dynamics of an adopted the extended ML neuron model 
is given by 



dwi 



dt 

dzj 

dt 

m 



+gL{vL - Vi) + ai + Ii{t) + (5y ^i{t), 
Wo{Vi) - Wj 
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(15) 
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where the sigmoidal function G(t') is given by (^(t;) = l/[l+exp{v—6)/a] with the coupling 
constant J, the threshold (= — 10 mV) and the width a (= 1), self-coupling terms being 
excluded. and express the strengths of independent white noises of ^i(t) and rii{t) 
with zero means and < ^i{t) Q{t') >=< 7]i{t) y]j{t') >= 5ij5{t — t') and < ^i{t) y]j{t') >= 0; 
other notations are the same as in Eqs.(l)-(10). The model parameters of and bi are 
assumed to be heterogenous and their distributions obey the Gaussian distribution with 
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(20) 
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where Sai = ai — e. We have adopted the same model parameters as for a single ML model 
discussed in Sec. 2.1 otherwise noticed. 
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3.2 Calculated results 

3.2.1 Homogeneous ensembles with no noises 

When we perform simulations for 10-unit homogeneous ML neuron with no noises and 
no couphngs (e = 39.6, \ = 0, u = 0, = and (3^ = 0, and J = 0), we get the result 
in which time courses of state variables of v, w and z of all neurons in the ensemble are 
the same as that shown in Fig. 1(a) for a single ML neuron; f{t) and r{t) are also the 
same as those in Fig. 1(c) and 1(d). In the following, we will investigate effects of the 
heterogeneity and noises on the persisting activity in ML neuron ensembles. 

3.2.2 Effects of heterogeneity 

Raster in Fig. 4(a) shows firings of neuron ensembles when the heterogeneity of A = 1 is 
introduced to the parameter of a^. Raster shows that due to the introduced heterogeneity, 
firings of some neurons are increased while those of some neurons are decreased, compared 
to those in homogeneous neuron ensembles. For example, five neurons with large 
fire before the first impulse is applied, which yields a finite firing rate at t < 1000 ms. 
Nevertheless, the firing rate averaged over the ensemble is not so different from that of 
the homogeneous ensemble shown in Fig. 1(d). 

Raster in Fig. 4(b) shows firings of an ensemble when the heterogeneity of = 2 x 10~^ 
is introduced to the parameter of bi . The firing becomes irregular due to the introduced 
heterogeneity. However, the histogram of firing rate averaged over the ensemble shows a 
stable, persisting firing. 

3.2.3 Effects of noises 

We have added white noises to a ML neuron ensemble. Raster of Fig. 4(c) shows firing 
of the ensemble when noises with = 4 are added to the variable v. Because of added 
noises, firings of an ensemble become irregular. Despite added noises, a stable, persisting 
firing is realized as the averaged firing rate r{t) shows. 

When white noises oi (3^ — 2 is added to the variable z, firings of an neuron ensemble 
become irregular, as raster in Fig. 4(d) shows. We note from the histogram that firings 
show a stable, persisting activity. 

3.2.4 Effects of couplings 

We have so far neglected the couplings among neurons (J = 0) which are now taken 
into account. In order to examine the firing synchrony in an ensemble, we consider the 
quantity given by 

m = ^Ej:<hii)-^M'>, (22) 

which is zero in the completely synchronized state. By using a proper normalization factor 
of Ro{t) — 2(1 — 1/N)^{t) which expresses the R{t) value for an asynchronous state, we 
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define the synchronization ratio given by (Hasegawa, 2003a, 2003b) 



where 



^^^^ ^ N(N-l) ^^ <^^.(^)c^^,(^) >, (24) 
lit) = ^E<^^^W'>> (25) 

i 

with 5f.j(t) = Vi(t)— < Vi(t) >. It is easy to sec that S{t) is 1 and for the completely 
synchronous and asynchronous states, respectively. 

The lower frame of Figs. 5(a) shows the time course of the frequency f{t) calculated 
for an ensemble with the heterogeneity of A = 1 and no couplings {J — 0) by 100 trials. 
This should be compared to the histogram for the rate shown in Fig. 4(a), which has been 
calculated by a single trial. The middle frame of Fig. 5(a) expresses the synchronization 
ratio S{t), which is vanishing because of the heterogeneity (with no couplings). Lower 
frames of Figs. 5(b), 5(c) and 5(d) show f{t) for introduced couphngs of J = 20, 40 
and 60, respectively. The distribution of f{t) for J = 20 become wider than that for 
J — 0. This may be understood as follows. When any neuron with a large fires, its 
spike propagates through couplings and induces firings in other neurons of an ensemble. 
When the coupling is furthermore increased, however, the distribution in f{t) is reduced 
as the lower frame of Fig. 5(d) for J — 60 shows. In contrast, the synchronization ratio 
S{t) shown in the middle frames of Fig. 5(b), (c) and (d) is gradually increased as J is 
increased. It is interesting to note that the synchronization ratio is enhanced by transient 
impulses, and that S{t) is gradually developed as more impulses are applied. 

Figures 6(a)-6(d) show similar plots of f{t) and S{t) for ensembles with various cou- 
plings subject to noises of /3„ = 4, calculated by 100 trials. Lower and middle frames of 
Fig. 6(a) show that for J — 0, f{t) has a wide distribution and S{t) is zero due to noises. 
When the coupling is introduced, the distribution of f{t) is once increased for J = 20, but 
reduced for stronger J = 40 and 60 while the synchronization ratio S{t) is monotonously 
increased as increasing J. The J dependence of f{t) and S{t) in Figs. 6(a)-6(d) is the 
same as that in Figs. 5(a)-5(d). 



4 Conclusion and Discussion 

In this paper, we have first proposed a minimum, conductance-based model showing the 
graded persisting activity by incorporating a calcium channel (Lowenstein and Sompolin- 
sky, 2003) to the ML model (Morrris and Lecar, 1981; Rinzel and Ermentrout, 1989). 
Then, by employing the extended ML model, we have studied effects of distractions such 
as noises and the heterogeneity in model parameters on the persisting activity of single 
and ensemble neurons. The activity of single ML neurons is vuhicrable because the fre- 
quency of persisting firings is modified by the distractions. In particular, even a small b 



10 



(= 2 X 10~^) yields a slow drift in the sustained frequency [Fig. 3(b)]. This is partly due 
to the fact that the value of the variable z is very small (~ — 0.06) compared to those of 
V and w. As discussed in appendix A, a vanishing of the drift requires 6 = 0, which is re- 
alized when parameters of Ci, and C3 satisfy the condition given by C2 = (ci + C3)/2 [Eq. 
(A13)]. This condition may be relaxed when a given neuron has multidendritic branches, 
for which h is expressed by 6 =< 6^ >m; being the h term relevant to the mth dendrite 
and Om the average over multidendrites. The averaging over multidendrites is expected 
to yield 6 = for single neurons. Even if h remains finite (but small), the drift of the 
sustained frequency may vanish in neuron ensembles [Fig. 4(b)] because of the pooling 
(ensemble) effect which is widely observed in various neuronal fTinctions. Although we 
have made simulations only for several typical sets of parameter values, they have shown 
that the graded persisting activity of a neuron ensemble becomes more robust against 
distractions than that of a single neuron again by the pooling effect 

The temporally correlated neuronal activity, the synchrony, has been considered to be 
important to various neuronal processing such as perception (Gray and Singer 1989, Gray, 
Konig, Engel and Singer, 1989) and attention (Steinmetz et al. 2000, Fries, Reynolds, 
Rorie and Desimone 2001). Recently the temporal structure in neuronal activity during 
working memory has been observed in parietal cortex of monkey (Pesaran, Pezaris, Sahani, 
Mitra and Andersen, 2002). Our calculations have shown that couplings among neurons 
enhance the synchrony, which is expected to be beneficial to firings of target neurons. It is 
necessary to make more detailed study on the interaction and synchrony in neuron ensem- 
bles with the persisting activity. Our calculations in this study have been based on direct 
simulations. We are under consideration to apply, to the ML model, a semi-analytical dy- 
namical mean-field theory which was successfully applied to large-scale neuron ensembles 
described by FitzHugh-Nagumo and Hodgkin- Huxley models (Hasegawa, 2003a, 2003b). 
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Appendix A. Derivation of Eq.(3) 

Assuming a long, linear dendrite for x G [— L, L], Lowenstein and Sompolinsky (LS) 
(2003) have shown that the Ca^"^-dependent cation current is given by 



Icat{t) = 9catZ{t) {V -Vcat), 

with the spatially-summed Ca^"*" concentration of z{t) given by 



z{t) 



-L 



dx c{x, t), 



(Al) 



(A2) 



where c{z, t) stands for the space- and time-dependent Ca^"*" concentration satisfying the 
partial differential equation given by 



dc(x,t) , , , d'^cixA) , , , , 

^ ^ ^ h{c{x, t)) + D ^ ; ' + k{c{x, t)) I{t). 



dt 



dx"^ 



(A3) 



Here h{c) — —K{c — ci)(c— 2)(c — C3) and k{c) — {K/2){c3 — ci)(c — ci)(c — C3) with 
Ci < C2 < C3, I{t) denotes an input signal, D the diffusion constant and K the positive 
coefficient. The functional form of h{c) shows that the state is bistable at c = Ci and 
c — C3 but unstable at c = C2. LS have shown that the solution of Eq. (A3) for the 
boundary condition of c{—L, t) = and c(L, t) = Ui, is given by 



c(x, t) ^ C2 + 



(— ^ 1 tanh 


'x - p{ty 


\ 2 J 


A 



(A4) 



with 



where 



P(t) = P(0) +ut + s dt' I{t'), 

Jo 



A = 



u 



ca - ci 
V2DK 



C2 - 



I2D 

'Cl + C3 



{c3-ci)V2DK. 



(A5) 

(A6) 

(A7) 

(A8) 



Equations (A4)-(A8) imply that the position of the front of Ca^^-concentration moves 
with the velocity of u, and it is proportional to the integral of the input signal I{t). By 
using Eqs. (A1)-(A8), we get 



dz 
'dt 

with 



C3 - Cl 



b + dl{t), 



tanh 



-L-Pjt) 
A 



tanh 



L - P{t) 



A 



dPjt) 
dt ' 



(A9) 



(AlO) 



h = (C3-Ci)w, 
d = (C3 - Cl) s. 



(All) 
(A12) 
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leading to Eq. (3), where the first term is included for the relaxation process of z. 
Equations (A8) and (All) show that h does not vanish unless parameters of ci, C2 and C3 
satisfy the condition: 

C2 = ^ , (A13) 

although LS adopted 6 = assuming the condition given by Eq. (A13). 

For a single neuron with M-unit multiple dendritic branches where the same sig- 
nal is applied to all synapses, the equation of motion for the averaged variable of 2; = 
Sm=i ^rn =< >m is again givcu by Eq. (AlO) but with b =< hm >m and d —< dm >m 
where Zm, hm and dm denote quantities relevant to the mth dendrite. 
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Figure 1: Time courses of (a) v, w, z and I and (b) Ik, Icat and Ica of a single ML neuron 
with Ai = 20, a = 39.6 and h — w, z and / are multiplied by factors of 100, 500, 
and 10, respectively, and are shifted downward by 100, 150, and 180, respectively; Icat is 
multiplied by a factor of 100, and Ica is shifted downward by 30. (c) The time course 
of the frequency fit) which is the inverse of ISI, with = 10 (inverted triangles), 20 
(circles) and 30 (triangles), (d) The histogram depicting the rate r{t) of firings shown in 
(a) and (b) with the time bins of Ti, — 200 (the solid curve), 400 (the dashed curve) and 
600 (the chain curve). 



Figure 2: (a) The v — w and (h) z — v phase planes relevant to firings shown in Fig. 1; 
dashed and chain curves in (a) express nuUclines of Eqs. (1) and (2) for A^ = 20, a = 39.6, 
6 = 0, ^ = and 7 = 0. 



Figure 3: Time courses of the frequency f(t) of a single ML neuron (a) for a = 41 
(triangles), 39.6 (circles) and 39 (inverted triangles) with b = 0, f3^ = and f3z = 0, (b) 
for b = 2 X 10~^, (circles) and —2 x 10~^ (inverted triangles) with a = 39.6, (3y = and 
Pz = 0, (c) for a = 39.6, b = 0, (3y = 4, and (3^ = 0, and (d) for a = 39.6, 6 = 0, /3„ = 0, 
and Pz — 2: an input signal is shown at bottoms, and results of (c) and (d) are calculated 
by ten trials. 



Figure 4: Rasters showing firings of 10-unit ML neuron ensembles and histograms ex- 
pressing the firing rate r{t) with time bins of TJ, = 200 (sohd curves), 400 (dashed curves) 
and 600 (dot-dashed curves) for (a) A = 1, i/ = 0, /3„ = 0, = 0, (b) A = 0, i/ = 2 x 10"^ 
= 0, = 0, (c) A = 0, z/ = 0, (3,^ = 4:, f3z = and (d) X = 0, u = 0, = (3, = 2, with 
e = 39.6 and J — 0, calculated by a single trial, an input signal being shown at bottoms. 



Figure 5: Time courses of the frequency f{t) (lower frames) and the synchronization ratio 
S{t) (middle frames) of heterogeneous ML neuron ensembles for (a) J = 0, (b) J = 20, 
(c) J = 40 and (d) J = 60, with A = 1, = 0, e = 39.6 and p^ = 0, calculated by 100 
trials; an input signal is shown in upper frames, and left and right ordinates are for f{t) 
and S{t), respectively. 



Figure 6: Time courses of the frequency f{t) (lower frames) and the synchronization ratio 
S{t) (middle frames) of noisy ML neuron ensembles for (a) J = 0, (b) J = 20, (c) J = 40 
and (d) J = 60, with P^ — 4, X — 0, e — 39.6 and P^ = 0, calculated by 100 trials; an 
input signal is shown in upper frames, and left and right ordinates are for f{t) and S{t), 
respectively. 
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